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SPHERICAL TRANSFORM AND JACOBI POLYNOMIALS ON 
ROOT SYSTEMS OF TYPE BC 


GENKAI ZHANG 

Abstract. Let R be a root system of type BC in o = R r of general positive mul¬ 
tiplicity. We introduce certain canonical weight function on R r which in the case of 
symmetric domains corresponds to the integral kernel of the Berezin transform. We 
compute its spherical transform and prove certain Bernstein-Sato type formula. This 
generalizes earlier work of Unterberger-Upmeier, van Dijk-Pevsner, Neretin and the 
author. Associated to the weight functions there are Heckman-Opdam orthogonal 
polynomials of Jacobi type on the compact torus, after a change of variables they 
form an orthogonal system on the non-compact space a. We consider their spherical 
transform and prove that they are the Macdonald-Koornwinder polynomials multi¬ 
plied by the spherical transform of the canonical weight function. For rank one case 
this was proved earlier by Koornwinder. 


Introduction 

The Gaussian functions and the Hermite polynomials play an important role in 
Fourier transform on Euclidean spaces; the Hermite polynomials diagonalize the har¬ 
monic oscillator and the corresponding Hermite type function diagonalize the Fourier 
transform, which make the Plancherel theory more transparent. The generalization 
of the Plancherel theory to any non-compact symmetric symmetric spaces has been 
studied intensively and there are still no general theory generalizing corresponding the 
results of Hermite polynomials and their Fourier transform, and above all, no concrete 
orthogonal systems of functions with explicit spherical transforms are constructed. In 
the present paper we will establish such a theory for root system of type BC. 

Now associated with any root system in R r there are two kinds of remarkable orthogo¬ 
nal polynomials, namely the Heckman-Opdam orthogonal polynomials giving the spec¬ 
tral decomposition of the algebra of the Weyl group invariant polynomials of Chered- 
nik operators acting on certain L 2 -space on a compact torus T, and the Macdonald- 
Koornwinder polynomials orthogonal with respect to certain weight functions on M r 
defined as a product of Gamma functions. Part of the product is in fact the Harish- 
Chandra Plancherel measure for the spectral decomposition of the algebra of Cherednik 
operators on the non-compact space M r . In the present paper we will introduce cer¬ 
tain canonical weight function /_ 2l ,(t) for root system of type BC, and we compute its 
spherical transform /_ 2 i/(A). The product of /_ 2j ,(A) 2 with the Harish-Chandra measure 
|c(A)|^ 2 gives precisely weight functions in the Macdonald-Koornwinder orthogonality 
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relation; we prove further, roughly speaking, that the Jacobi polynomials on the com¬ 
pact space, after some change of variables, and multiplied by the function /_ 2l , give 
orthogonal system of the L 2 -space on the non-compact space, and that their spherical 
transforms are of the form /_ 2 i ,(A)p(A) where p( A) are the Macdonald-Koornwinder 
polynomials. Thus the function f_ 2v plays the role of the Gaussian functions in the 
Fourier analysis whereas the Jacobi and Macdonald-Koornwinder polynomials play the 
role of the Hermite polynomials and their Fourier transforms (up to a multiple of the 
Gaussian). In rank one case this has been proved earlier by Koornwinder [§j. 

We remark that only the spherical transform of Weyl group invariant functions are 
studied in this paper, yet we use the tools of the Cherednik operators acting on general 
functions with no invariance, which makes the computation much easier. Some of our 
results can also be easily be generated to that setup. 

Our results are motivated by the study of the Berezin transform and branching rule 
of holomorphic representations on weighted Bergman spaces on bounded symmetric 
domains G/K ( IT51J and [IS)- To illustrate our result and explain some of the mo¬ 
tivations we consider the simplest case of a symmetric domain, namely the unit disk 
G/K = {z £ C; \z\ < 1} with G = 517(1,1) and K = 17(1). The root system is {±4e} 
on a = K in our notation in Section 1. The Berezin transform in question is a group 
convolution operator in the space L 2 (G/K ) = L 2 (G/K , ) with kernel (1 - \z\ 2 ) u . 

The canonical weight function /_ 2 i ,(t) is just the kernel (1 — \z\ 2 y with z = tanh t 
in term of the geodesic coordinate t. The spherical transform /_ 2 i/ (A) of gives 

the spectral symbol of the Berezin transform, and it has been computed for general 
bounded symmetric domain by Unterberger and Upmeier DU (see also Da. 0 and 
|15|). Now there is an orthogonal basis of the space L 2 (G/K) k of radial functions of 
the form (1 — \z\ 2 ) u P(z) where P(z) are the Jacobi polynomials, z = tanh t £ (— 1 , — 1). 
The Jacobi polynomials (depending on u) are given by the corresponding spherical 
polynomials of the same root system with different multiplicity on the compact torus 
T = iM./i 7 rZ, with the change of variable z = sins for s G T = iM./inl* (see Section 5). 
It has been proved by Koornwinder fjj that the spherical transform of (1 — \z\ 2 ) u P(z) 
is of the form f_ 2 u(X)Q(X) where Q( A) is the Wilson 4 F 3 hypergeometric orthogonal 
polynomials. Thus Q(X) are orthogonal with respect to /_ 2 ^(A) 2 |c(A)| _ 2 dA. 

The Macdonald-Koornwinder polynomials are the multi-variable generalization of 
the Wilson’s 4 F 3 hypergeometric orthogonal polynomials, and can be viewed as the 
most general case of a hierarchy of classical polynomials HH. We introduce the canon¬ 
ical weight function /_ 2 „ on a general root system of type BC, compute the spherical 
transform for functions of the form /_ 2l ,P with P being the Jacobi polynomials studied 
by Heckman-Opdam. 

The paper is organized as follows. In Section 1 we recall the Plancherel formula for 
Opdam-Cherednik transform. In Section 2 we find certain Bernstein-Sato type formula 
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for the so-called canonical weight function f$. Its spherical transform is computed in 
Section 3. Finally we compute the spherical transform of certain Jacobi-type polyno¬ 
mials in Sections 4 and 5. 

It is our belief that most results in this paper can be generalized to general root 
systems, that will provide a theory of Hermite-type functions on non-compact space 
and thus bring together the orthogonal polynomials on compact torus and spherical 
transform on non-compact space. 

I would like to thank Professors Jacques Faraut, Toshiyuki Kobayashi, Erik Opdarn, 
Jesper Stokman and Harald Upmeier for some helpful discussions. 

1. Spherical transform and Plancherel formula 

Let a = R r be an Euclidean space with inner product (-, •) and let R C a* be a root 
system of type BC. A prototype of such root systems is the restricted root system of a 
bounded symmetric domain. We use some familiar notation, in order to be consistent 
with the notation in the context of bounded symmetric domain and also in the context 
of Plancherel formula for general root system f9]. We fix an orthonormal basis {^}i 
of a and a dual basis {ej} of a*, i.e., £j(Z,k) = 5jk, so that the positive roots are 
R + = {2 £j\j = 1, • • • ,r} U {4 £j-J = 1, • • • ,r} U {2(e i ± e fc ); 1 < j < k < r}, with 
respective multiplicities (k\,k 2 , k 3 ) satisfying 

2(k 1 ,k 2 ,fa) = (26, t,a). 

We assume that i, a, b > 0. We order the roots so that £i > £ 2 > ■ • • > £ r > 0. 
The Weyl group is then W = S r x consisting of signed permutation of {£.,•}. Let 
p = | J2aeR+ be the half sum of positive roots. Then 

r r 

P = Y1 p i £ i = + b + ( r “ 

3=1 3=1 

We recall briefly in this section the Plancherel formula for the spherical transform 
associated to the root system R developed by Heckman and Opdarn (0, d and U). 
Let dp be the measure 

dp(t) = dpkit) = 12 sinh(- a(t))\ 2ka dt 

a€R+ 

on a, and let L 2 (a) = L 2 (a,dp ) and L 2 {a) w be the corresponding L 2 space and its 
subspace of IE-invariant functions. 

Let 

D j = d j ~ a ^2 i _ e -2(t i -q)( 1 - s h) + a i _ e -2(t J -t fc )( 1 _ S A') + 
i<j j<k 

a J2 1 _ e -2(t j+ t k ) ( 1 - a 3k) + 2i 1 _ 1 e - Uj (l - (Tj) + 2b l _ 1 e _ 2tj (l ~ CTj ) - pfo) 
i¥=3 
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be the Cherednik operators acting on functions f(t) on a‘ L , where we identify a function 
f{t) on a c with f{t\, ■ ■ ■ ,t r ), for t = t\f\ + • • • + t r f r . Here Sij, aij, are the elements 
in the Weyl group, Sij = ( ij ) being the permutation of and fj, the signed per¬ 
mutation, <Jij(£i) = —fj^ijifj) = —fi, <Tj the reflection a j(£j) = —£*, and all mapping 
fk —»■ fk for k 7 ^ i, j. For later purpose we will also rewrite it as 

Dj = dj-a^2 eU - tj _ e _( ti-tj ) _ s v) + a 57 _ e -(tj-t k ) _ s i fc ) + 

i<j j<k 

_—^ g2t,- 

+ a g t ,+t fe ^g- fe+ t fc )( 1 - ^i*) + 2i e 2t, _ e -2 tj - a t) 

* 

+ 2 h«, e -’e -‘ S (1 ~ ai) ~ 

The operators {Dj} are then commuting, and the decomposition of L 2 (a) with re¬ 
spect to the eigenfunctions of {Dj} is given by the Cherednik-Opdam transform [2j, 
formulated in terms of decomposing representations of a Hecke algebra. We will mostly 
be concerned with the decomposition of L 2 (a ) 11 under VF-invariant polynomials of 
Dj,j — 1, ■ • • , r, which is given by spherical transform in terms of the Heckman-Opdam 
theory of hypergeometric functions (jSj and [3]); we shall however use the operators Dj 
(in place of their symmetric polynomials) to compute the spherical transform of sym¬ 
metric functions. 

For A G (a*) c let <f \ be as in [9] the spherical function. In particular 

(1-1) p(Du ■■■ , D r )<j> A = p( A( 6 ), • • ■ , A(£ r ))</> A , 

for any IF-invariant polynomial p. The spherical transform of a function / G L 2 ( a) 11 

is 

7(A) = I f(t)(f>x(t)d(j,(t). 

J a 

The corresponding Plancherel measure is given by 

« a > = 

where 

t-t r(Aj + b)r{2\j) t r F(A j + e\ k ) 

jj i r (A j + b + i) r ( 2 A j + 2 b) 1 < J< ]:< r , :e=± r (A j + eA fc + §) 

and 

= ./ \ _ TT F (pj + b+ l)T{2pj + 1) -p-r Tjpj + ep k + 1) 

J=i r (^' + b + I + 1 ) r ( 2 Pi + b + l) 1 < i<fc < J . )£=± r (di + e Pk + f + 1) 

Namely, we have 

(i. 2 ) [m\ 2 dp(t)=l \J(\)\ 2 dm. 
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2. Bernstein-Sato type formula for the function f s 
We define the weight function f§ on a by 


r 

fs{t) = JJcosh*^. 

3 = 1 

Motivated by the Berezin transform ([i(I|, |E|, 03) we call fs the canonical function. In 
the case of bounded symmetric domains fs is the integral kernel of the Berezin transform 
considered as a convolution operator defining the so-called canonical representations, 
and is the analogue of the Gaussian functions in the Euclidean space, see loc. cit.. 

In this section we prove the following Bernstein-Sato type formula: 

Theorem 2.1. There is a W-invariant polynomials of the Cherednik operators Dj 
mapping the canonical function fs to fs-i', more precisely, we have 

r r 

(2.1) Yl i D j - ( 5 + p(£i)) 2 ) fs = n ( 5 + - !)) (! - <5 - ^ - a( r - j)) fs- 2 

i=i j = 1 

The proof of it will be divided into two technical lemmas. 

Lemma 2.2. The following formula holds 

3 3 3 

n (a++pk,» m = - dj/RU IK 1 + tanh t() 

i=i i=i i=i 


Proof. We prove the lemma by induction on j. First we have, since fs is Weyl group 
invariant, 


D 1 f s = 5 t&nhti fs - p(£i)fs, 
where we use J^cosht = tanh t cosh t. Rewriting, 

(L>i + 5 + p(£i))fs = 5(1 + tanhfi )f s , 

which is the claim for j = 1. Assume that the equality is true for nti(A + (5 + p(£i))). 
We consider it for j in place of j — 1 . We need to compute the operator Dj + 5 + p(£i) 
on the function fs nf=i (1 + tanh tj ) . This function is invariant under the permutations 
of the first j — 1 coordinates and the signed permutations of the last r — j coordinates. 
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Thus 


Djfs (1 + tanhtj) 
i<j -1 

S tanh tjfs (1 + tanh t[) 
i<j -1 


~ a fsJ2 


g ti tj 


- (tanh U — tanh tj ) (1 + tanh ti ) 


(=>ti tj — g (ti tj) 

i<j Z<j—l,Z^i 


+ afs^2 


^t-i tj 


- (tanh ti + tanh tj) (1 + tanht;) 


g ti~\~tj _ g (ti~\~tj) 


-p(£t )/<5 n (1 + tanh ti 


i<i -1 

Using the formulas tanh a; ± tanh y = bl ” h U±;/) an d e x _ n _|_ tanh x) cosh x we 

° a cosh x cosh y v J 

see that the sum of the zth terms in the two summations is, apart form the factor 


^n^-i^a+tanht,), 


^t% + tj 


£>titj _ g 


———(tanh t t + tanh t 7 ) — 

\ti\tj ) 


gti tj 


e li ^ — e~ 


jf—pj (tanh t i — tanh tj ) 


= 2(1 + tanh tj) tarihtj, 


and thus 

Djfs (1 + tanhtj) 

i<j -1 

= ((5 + a(j - 1)) tanh tj - p(£j)) fs (1 + tanh t,). 

l<3 -1 

It follows then that 

(■Dj + h + p(£i))fs n (1 + tanh tj) 

Kj-l 

= (h + a(j - l))f s JJ(1 + tanh tf) + (p(fi) - />(£,-) - a(j - l))/ 5 JJ (1 + tanht,). 
i<j i<j -i 


But />(£,-) 


t+ 6 +a(r—j) so the second term vanishes and this completes the proof. □ 


Lemma 2.3. The following formula holds 

J] (A - (6 + p(Si))) /j-ie“ + - + ‘' 

l>3 

= (1 - 5 - i ~ a(r — /)) fs-ie tl+ '" +tr JJ (1 - tanh tf) 

l>3 l>3 

Accepting temporarily the Lemma, we prove Theorem 12.11 We write the LHS as 

r r 

n< a - (« + P« i))) n< A + (6 + p(Si)))/s 

1=1 1=1 
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Taking j = r in Lemma 12.21 we see that Wfi=\{Di + (5 + p(£i)))/<5 disregarding the 
constant, given by, 

r 

fs JJ(1 + tanh tj) = fs~ie tl+ "" +tr ■ 

i=i 

Theorem IQ then follows from Lemma IP for j = 1, by using the identity 

r 

fs-ie tl+ "' +tr JJ(1 - tanh tj) = f S - 2 - 

3 = 1 

It remains to prove the Lemma. 

Proof. We first compute D r and use induction backward. We have 
D r f s -ie tl+ - +tr 


fs -i JJ e tl + (5 - l)f 5 -i tanh t r JJ i 


l<r 


a fs~i ^2 






l<r 


0 ti~\~t r _ — 


i<r 


n 


e tl + 


t r 


2 Lfs-l 


2bf s -i 




(e tr - e tr 


_ g tr 


(e tr - e tr 


) n eti+ 

l<r —1 

I I e±l -p(£r)fs -1 n 


l<r—l 


l<r 


The third term can be simplified as 


a(r - l)fs-i JJe*', 

l<r 


and the next two terms are 

Lt&nhtrfs-i e tl + (l + 2b)f S -i e tl . 

l<r l<r 

So that the previous formula is then 

(6 - 1 + t) tanh t r fg_i e tl + (1 + i + 2b + a{r - 1) - p{f r ))fs-i e tl 

l<r l<r 

= {5 - 1 + t) tanhf r / 5 _i e tl + (1 + b + p(£i) - p(£ r ))fs-i e tl 


and consequently 

{D r 


l<r 


(pi+'5(fi)))/j- 1 e“ + "' + ‘ 


l<r 


= {5-1 +l) tanh t r f$-i JJ e tl + (1 + b - 5 - p{f r ))fs-\ e tl 

l<r l<r 

= {5 - 1 + i) (tanh t r - l)f S -i e tl , 

l<r 

since 1 + b — 5 — p(£ r ) = — {5 — 1 + t). This is the Lemma for j = r. 
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Assume the lemma is true for the action of — + p(£i)))- We compute 

(Dj -(8 + p{£i)))fs-i HU" tanht i) JJe*' 

l>j+l l<r 

and hnd it is 

— (1 — tanhfj) (a(r — j) + t + 8 — l)fs-i id — tanhf;) ]^[ e tl 

l>j l<r 

by a straightforward yet tedious computation. □ 

Remark 2.4. Consider the double Hecke algebra generated by the Cherednik oper¬ 
ators, the group ring C[W], and C[P] of polynomials e £j as multiplication operators 
on C[P]. Some refinements of the above computation then gives certain commutation 
relations of the Cherednik operators with e £1+ "' +£r ', which might be of independent in¬ 
terests. This Theorem (or its equivalent version under the spherical transform, see the 
proof of Theorem 3.2) can possibly be obtained also by using intertwining relations of 
the Cherednik-Opdam transform with the double Hecke algebras proved by Cherednik 
[ 2 ], it would involves nevertheless many intriguing computations. 


3. Spherical transform of the function f s 


In this section we shall use Bernstein-Sato type formula for the function f_ 2u to 
derive a recursive formula for its spherical transform /_ 2 „(A) (for sufficiently large v). 
By using a limit formula we then derive a product and, consequently, a Gamma function 
formula for f_ 2u (A). 

Denote 

r 

r a(» = ^ ~ 

3 = 1 

which in the symmetric domain case is the Gindikin Gamma function; it will be used 
to simplify certain product formulas. 

We compute first some normalization constant, which corresponds to the spherical 
transform of f_ 2v at A — p. 

Lemma 3.1. Let v > t + b + a{r — 1). The integral 


is given by 




N u = f- 2v (t)dfj,(t) 

J a 

2 r(2t+26+a(r-l) |p , L + 1 + 2b + a(r - 1) 

• at 2 > 

T a (p — (f (r — !) + <■ + b)) n T(f(j-» + l) 

^(-+¥) ,M<r r (f(j-^) 


X 
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Proof. By symmetry we need only to integrate over all s = (si, • • • ,s r ) with Sj > 0. 
Making the change of variables Zj = tanh 2 tj, we hnd first that 

N v = 2^ +2b+a ( r ~ 1 » r f | J "[fa - Zj ) a \fj fj(l - ^)" _(1+t+6+a(r ' 1)) ^i • •' dzr 

•'M r i<j i= i f=i 

which is evaluated by the beta integral (see pj Ex. 7, Sect. 10, Chapt. VII]) that 



mi[t° f(r 1} 1 f[(i-t i )^ r ~^- i dt 1 ---dt r 

i= 1 i=1 


— r* I 


n 

l<i<j<r 


r(f(7-i + i)r fc (a)r fc 09) 
r(f(j -f) r k (a + p)' 


□ 


In particular it follows that 

Nu+i _y\ u ~ (f ( r ~ !) + i + b) - f (j - !) 

^ jL A i ^ + ¥- to-1) 

Changing j — 1 to r — j and using p(£i) = t + b + a(r — 1), we can rewrite it as the 
following 

fo 1 \ ^+i _ rr 22 - Ip¥) - + b + a (j -1)) 

(-) ^ " + ¥-| 0 '-i) 


Theorem 3.2. Let v > t + b + a(r 


f-2„( a) = iv, n ii 




— 1). The spherical transform of f_ 2 v Is given by 

!>- jpgi) + 4 A ¥)) \ • * 

|p(6) + 4(i + 6 + a(j-l)))’ 


The following result is elementary and we omit its proof; it is proved in US in the 
case when the root system corresponds to a bounded symmetric domain. 


Lemma 3.3. Let <f be a bounded and continuous function on a. Then 

lim V - [ f~to(t)<i>(t) d ii(t) = 0(0) 

We prove now Theorem 3.2. 

Proof. We write j3 v {X) = anc ^ com P u f e if i n terms of (3 V+1 (\). We note first that 

it is well-defined for A G fa*. Indeed the spherical function <f>\ (t) is a bounded function 
!2], and the function /_ 2v is in L 1 ( a*, dp) by Lemma 3.1. We perform the spherical 
transform on the identity m with 5 = —2v. Using m we have, 

r r 

II ( A (^) 2 _ ( _2z/ + d(£i)) 2 ) A¥) = II ( _2z/ + _ (! + 2l/ ~ L ~ a ( r - j)) 0v+i(A), 
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and 


m a)= n 

3 = 1 
r 

n 


(-2z/ + a(j - 1))(1 + 2 u-l- a(r - j)) 
(Afe) 2 -(-2 ^ + p(6 )) 2 ) 

(n-f(j-l))(n + ^-f(r-j)) 


7 i ((u ~ |p( 6 ) + (£,)) (0 - |p( 6 ) + |A(^-)) 


Ah-i(A) 

Ah-i(A) 


We write further the denominator as 


j=i 

i=i 


Thus 


q /\\ _ N "+ l TT ( U — |d(£l) + U L + b + a (J - l)))^ + V _ fC? - X )) a /w 

M } N v l\ („ - |p(6) + iA(^,-)) (* - §P&) - §A&)) ^ ] 

Using (18.11) this becomes 

(u + |p(£i) + + b + a(j — 1))) (u + |p(7i) — \{l + b + a(j — 1))) 


A(A) = /WA)H 


J =1 

r 


- \p(ii) + |A(^)) (n - Ap(fi) - |A(^)) 


Am-i(a) n ( 1 + iUthtTfUilf ( 1 U + 6 + “0 -!)) 


X 1 + 


j=1 x ' 2 

|A(0) ' _1 

1 


v- 4p(6) 


v- \p(i\) 


V - 9/>(&) 



|Afe) 

!p( 6 ) 


-1 


Iterating we find 


A,(A) — A,+/c(A) 


TT TT (■. ^(l + 6 + a(j 1))\ A ^(i + fe + atj 1))\ 

fjfjv + A " «/ + i-i-ip(ei)y 


X 1 + 


mb) 


_ 1 


+ / - 1 - |p(£i) 





1 - 


|A(£,) 


+ / - 1 - 


-1 


2 UVS 1 J/ \ 1 “ 2 ' 

However fo iy+fc (A) —> 1 as k —> 00 by Lemma 3.3 since the function (p\(t) is a 
continuous bounded function for A G ia*. We get thus 


M A) = 


TT TT A 2( 6 + ^ + a (i 1))\ A 2( 6 + ^ + a (i 1))\ 

fifjv + v+i-i-±p(Si)J V " «/+1 -1 -ip(6)J 


X 1 + 




1 


^ + l - 1 - 2 d (£0 



1 - 


5 A &) 


z/ + / -! - 5 p( 6 ) 


-1 
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Our result follows rewriting the infinite product in terms of the Gamma function, using 


T(A)T(B) 


T(A + C)T(B -C) 


nc i + 


c 


8 =0 


A + s 


)(1 


C 


B + s 


); 


see !3 p.5]. 


□ 


Remark 3.4. The function f_ 2v (X) for v as above has exponential decay and is a 
bounded function for A G ia*, and holomorphic in a strip around ia*. We can then 
define the Berezin transform on L 2 (a,dp) w by the inverse spherical transform, namely 

B„F(t)= f f^ v {X)F{X)Mt)\c(X)\~ 2 dX. 

J ia* 

B v is then a bounded and positive operator and it has an integral kernel B(t,s). In 
particular B(t, 0) = /_ 2 v{t)- It follows then from the selfadjoint property of B that 
B(x,y) = f- 2 u (t)f- 2 v(s)L(t,s). It would be interesting to find a series expansion 
for the kernel L(t, s ) in terms of the Jack symmetric polynomials (in the variables 
(tanh 2 fi,-- - ,tanh 2 f r )). In the case of bounded symmetric domain, this is indeed 
possible, and some degenerate cases of the expansion have been studied in (TB] (see 
also [I] for related problems). 

4. Spherical transform of a class of functions 

We shall compute the spherical transform of a class of functions of the form 

f- 2 u(t)p(xl , • • • , x 2 ), xj = tanhtj, j = 1 , ■ ■ • , r, 

where p(x 2 ,••• , x 2 ) is a symmetric polynomial in (xi,--- , x r ). We will prove that 
they are of the form /_ 2l ,(A)g(A) where q is a symmetric polynomial in (A 2 , - •• , A 2 ). 
Eventually we will specify p to be Jacobi-type polynomials in the next section. 

We denote T> 3 the conjugation of Dj by the canonical function fg , 

V j = vf = f_ s D j f s , j — 1, - ■ ■ , r. 

The operators {T) ( p\ under the change of variables x 3 = tanh t 3 have the form 


V 3 = 5xj + (1 - x 2 Adj 


a \ 1 J- Xj — Xj — Xj Xj , . 

9 /_^ I I (A — S ij) 


i<j 




U, \ "V 

2 ^ 

j<k 


1 + Xj — Xfc — XjXk 
Xj Xfc 


(i - Sjk) + - 

Mi 


1 + Xj + Xfc + X k Xj 
Xj + Xfc 


(1 <Xjk) 


+ l ( 1 + — [xj H - ) J (1 — <Jj') + 6(1 H - )(1 — <7j ) — Pj 

Xj J Xj 


We shall consider the operators {XA y } acting on polynomials in x. For that purpose 
we recall the natural ordering > on the set of all partitions r/ = (t)i, ■ • • ,f] r ) G N r , 
Vi > ■ ■ ■ > Vr > 0 . For two partitions ( and r/, r/ > ( if rp > Ci, r/i + 172 > Ci + C 2 , ■ ■ •, 
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7 7 i + r 72 H— • + Tj r > Ci + C 2 H— • + Cr- For any 77 G N r denote by 77 * the unique partition 
in the »5' r -orbit of 77 . 

The following lemma can be proved by a direct elementary computation, it is similar 
to the known results that the actions of the operators Dj on C[P] are upper triangular. 

Lemma 4.1. The action of the operators Vj on the monomials x v = xf ■ ■ ■ xf r , rj G 
preserves the order in the sense that 

T>jX v = «^ rr x^, 

C 

where — 77 + (0, • • • , 0 , 1 , 0 , • • • , 0 ) and the coefficient of x^ is 

a v o,ri = S + a#{i < j : 77* > rjj} + '-(l - (-1)^). 

Remark 4.2. Some refinement of the above lemma can be obtained by using the 
Bruhat ordering on the set N r , however we will not need it here. 

Denoting m v the symmetric power sum 

(4.1) m v (y lr ■ ■ ■ , y r ) = ^ i/f ■ ■ ■ y$ T . 

(€SrV 

We compute now m v {fD\, ■ ■ ■ , T)‘f)\. 

Lemma 4.3. The operators m v {V{, ■ ■ ■ ,V' 2 ) acting on the constant monomial 1 gives 

m v (Vl, ■ ■ ■ T> 2 )1 = d r) m v (x 2 l , ■ ■ ■ x 2 r ) + lower terms, 

where the “lower terms ” here stand for a linear combination of symmetric power sums 
m v ' of x\,- ■ ■ ,x 2 with vf -< rj, and the leading coefficient is 

r Vj~ 1 

(4.2) d v = n n (^ + ( r ~~ 3 ) - + ( r - d) a + L - 1 - 2&). 

j =0 k =0 

Proof. This can be obtained by using the fact that m v (Df, ■ ■ ■ T> 2 )1 is Weyl group 
invariant and by applying Lemma 4.1 successively. □ 

Proposition 4.4. Let v > t — b—a(r— \) and let 77 : rji > 772 • • • > r] r > 0 be a partition. 
The spherical transform of the function /_ 2 l ,(£) 777 , ? (tanh 2 1\, ■ ■ ■ , tanh 2 t r ) is given by 

/X(A)Z„(A), 

and l v ( A) is W-invariant polynomial of X with leading term df 1 m v (X(fi) 2 , ■ ■ ■ , X(f r ) 2 ). 

Proof. We apply Lemma 4.2 for <5 = —2u. Observe that d v 0 for any partition 77 . It 
follows that for each partition 77 , 

rn^xl, ■■■ ,x 2 ) = d^m v (T>l, ■ ■ ■ V 2 )l + ^ c v > rfn^fV 2 , ■ • • V 2 )l. 
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In other words 

f-ivm^xX, ■■■ ,x 2 r ) = d^m v (Dj, • • • , D;)f_ 2v + ^ c ri , , n rn r{ {D\, • • • , D;)f_ 2 „. 

For each (, the spherical transform of m^(Df, • • • , D^)f_ 2l/ is given by, in view of 

m c (A(6) 2 w ,A(^) 2 )/^(A). 

Onr result then follows from the previous formula. □ 

5. Jacobi type functions and Macdonald-Koornwinder polynomials 

We recall briefly the Heckman-Opdam theory on Jacobi polynomials. We will then 
construct certain functions of Jacobi type and prove that their spherical transforms are 
Macdonald-Koornwinder type polynomials. 

Let v > l + b + a(r — 1). Consider now the same root system R with R + = {2 £j\j = 
1 , ■ ■ • , r} U {4:£j] j = 1 , • • • , r} U {2e 3 ± e k ] 1 < j < k < r} and with respective multi¬ 
plicities = (ki'\k 2 , \k 3 ^), such that 

2 k^ ] = 2 ( 2 u — (1 + l + b + a(r — 1))) + 1, 2 ( y k [ u ' 1 + k^) — t + 2 b, 2 k^ u) = a. 

(Note that one of the multiplicities, k[ u \ is negative, however they still satisfy the 
condition k a + k*> 0, Wa e R , see 0.) 

The corresponding dual coroot lattice is |(Zei + - • - + Ze r ) = (lZ) r and weight lattice 
is P = 2(Zei + • • • + Z e r ) = (2Z) r . The set of dominant weights is 

P + = { 2 (r ] 1 £ 1 -\ -b rj r £ r )\rj = (771, ■ ■ • ,hr) e N r ,?7i > • • • > 77,. > 0 }, 

and for simplicity we will identify the elements 2 rj in P + with the partitions rj € N r , 
and all r] appeared below will be assumed to be partitions. The partial ordering on the 
weight lattice P defined in terms of positive roots is exactly the natural ordering >. 

The polynomial algebra C[P] of integral weights is then the polynomial algebra gen¬ 
erated by e ±2£j ,j = 1, • • • , r as functions defined on the compact torus T r = ia/(mZ) r . 
Consider the inner product in the space C[P], 

( 5 - 1 ) (f,g)kM= f f(s)g(s)\S kW {s)\ds, 

J[0,n] r 

where S kM (s) = U a eR+ |2sin \a(s))\ 2k ^. 

We recall first the Heckman-Opdam theory of Jacobi polynomials, see IA, 9J. 

Lemma 5 . 1 . For each rj = (rji, ■ ■ ■ , rj r ) e N r , 171 > • ■ ■ > r) r > 0 , there exists a unique 
polynomial P U)71 on T such that 

r> W 1 \ ^ W 

Pv-.n — P-q "h / , C ri',vPr) 

r)'<ri 

and 

(-^, 77 ; PyOfcM = 0) 
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where = 'Yh w&w w{e 2( ' m£1+ '" +Tlr£r ' > ) is the Weyl group orbit sum of the power function. 
The polynomials {P vrj } ri forms an orthogonal basis for L 2 (T, |J fe o)(s)|<is) M '. 

The inner product {P v>r) , P v ^) k ( v ) is explicitly computed in Jo and {Sj- 

The Jacobi polynomials on T are symmetric with respect to the Weyl group W, thus 

they are symmetric polynomials of the functions -—- = cos2sj, which can be 

further identified as symmetric polynomials of (x\, ■ ■ ■ ,x 2 r ), with 

(5.2) Xj := sin Sj G [—1,1], s — Si£i + • ■ ■ + s r f r G T = zM r / (mZ) r . 

With some abuse of notations we denote it also by P v ^(xi,... ,x r ). We rewrite the 
characterization of P UtV in terms of the variables (aq,..., x r ). 

The Jacobi polynomial P v ^{x i,..., x r ) is then characterized as the unique polynomial 
so that 

Pu,rj{x 1 , ■ ■ ■ , x r ) = 2 2m+ ' +2Vr 7n v (xl, ■ ■ ■ , ^) + V! C vX m d X l’ ■ ■ ■ : x r) 

C<u 

and that 

{Pv,t]i m(f) k (v) — 0, C< V 

where {f,g) k w is the inner product (15.11) after the change of variables (15.21) . 

(/,0)fcM = 2 ^ +2b+ ^-D)r f 

(5.3) [ ~ 1,1]P 

X XJ k' - X 2 \ a \x 2b+i \ JJ(1 - x 2 ) 2 —0+'.+6+a(r-l) dxi . . . ^ 

i<j 3 3 

We now define the Jacobi type function on a, with the variable x = sins, s G T in 
P UtV being x = tanhf, t G a, 

(5.4) H UjT) (t) := f- 2 v(t)Pv,r,( tanhti, • • • , tanhf r ). 

Lemma 5.2. The functions {H^^ft)}^ form an orthogonal basis for the space L 2 (a) w 
and 

L 2 (a) Pv,r\)k^) 

Proof. Changing of variables t G a —» x G (—1, l) r , Xj := tanht, in the definition of 
inner product in L 2 (a), we get the above formula. The remaining claim follows from 
(the symmetric version of) Weierstrass approximation theorem. □ 

To state the next result we recall briefly (with some slight reformulation using 
the Harish-Chandra c-function and the function /_ 2 i/ (A)) the Macdonald-Koornwinder 
polynomials of type BC (also called multi-variable Wilson polynomials), see jTTj. There 
exists a unique system of polynomials (p(J /A (A)},, on M r , identified with ia*, such that 
they are orthogonal in the space L 2 (ia*, /_ 2 ^(A) 2 |c(A)|“ 2 (iA) w/ and such that pf l IK { A) 
has leading term m v ( A(£i) 2 , • • • , A(£ r ) 2 ). 
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Theorem 5.3. The spherical transforms of the Jacobi type function H vrj (t) on a are 
given by 

/-2i/(A)g^ 7? (A), A e ici* 

where q Vi71 { A) is a W -invariant polynomial. The polynomials {q v ,ni A)}^ form an orthog¬ 
onal basis of the space L 2 (ia*, /_ 2 j,(A) 2 |c(A)| -2 <i\) w ' ; their norm in that space is given 
by 

|| ( ?v,r;|| || || L 2 (a) II || fcO) i 

and they are up to constant multiples the Macdonald-Koornwinder polynomials {p MK (A)}. 

Proof. That the spherical transform is of the given form follows from Proposition 
4.4, the orthogonality relation is by the Plancherel formula G2D- Now the polyno¬ 
mials q v f A) are orthogonal, and have the leading term m, ? (A(£i) 2 , • • • , A(£ r ) 2 ), again by 
Proposition 4.4, thus they are multiples of the Macdonald-Koornwinder polynomials 
p MK ( A), by the uniqueness of the latter [TTJ . □ 
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